A Form of Information Entropy

Towards a Spatio-temporal Form of Entropy

entropy, negentropy, and information

evaluation criteria for different versions of the same database the concept of information, during its development, is connected to the concept of entropy created by the 19th century termodynamics scholars. information means, in this view point, order or negentropy. on the other hand, entropy is connected to the concepts as chaos and noise, which cause, in turn, disorder. in the present paper, ...

Implementation of a Low- Cost Multi- IMU by Using Information Form of a Steady State Kalman Filter

In this paper, a homogenous multi-sensor fusion method is used to estimate the trueangular rate and acceleration with a combination of four low cost (< 10$) MEMS Inertial MeasurementUnits (IMU). An information form of steady state Kalman filter is designed to fuse the output of four lowaccuracy sensors to reduce the noise effect by the square root of the number of sensors. A hardware isimplemen...

A New Estimator of Entropy

In this paper we propose an estimator of the entropy of a continuous random variable. The estimator is obtained by modifying the estimator proposed by Vasicek (1976). Consistency of estimator is proved, and comparisons are made with Vasicek’s estimator (1976), van Es’s estimator (1992), Ebrahimi et al.’s estimator (1994) and Correa’s estimator (1995). The results indicate that the proposed esti...

A Dynamic Model of Information and Entropy

We discuss the possibility of a relativistic relationship between information and entropy, closely analogous to the classical Maxwell electro-magnetic wave equations. Inherent to the analysis is the description of information as residing in points of non-analyticity; yet ultimately also exhibiting a distributed characteristic: additionally analogous, therefore, to the wave-particle duality of l...